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(57) Abstract: A process transmits digital data to an A/D converter via an analog channel. The process includes generating a se- 
quence of output signals by precoding a sequence of input signal points to precompensate for ISI in the analog channel. In the 
precoding is matched to the ISI, at least one of the output signals would be disorted by the ISI to a signal representative of a signal 
point lying between quantization levels of the A/D covnerter. If the precoding is matched to the ISI, others of the output signals 
would be distorted by the ISI to signals representative of signal points that are quantization levels of the A/D converter. A majority 
of the input signal points are quantization levels of the A/D converter. 
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UPSTREAM DATA TRANSMISSION 

This application claims the benefit of U.S. Provisional Application No. 
60/195,494; filed April 6, 2000; and U.S. Provisional Application No. 
60/249 J 23; filed November 16, 2000. 

5 BACKGROUND OF THE INVENTION 

Technical Field 

The present invention relates to transmitting digital data over analog 
channels. 

Background Art 

10 In many communication systems, a modem is used to transmit digital data. 

The modem converts the data into a sequence of signal points and transmits the 
signal points to a near-end central office via an analog channel. In the near-end 
central office, a pulse code modulation voice coder (PCM vocoder) maps the 
received signal points to a set of quantization levels. The near-end central office 

15 transmits the sequence of quantization levels upstream to a far-end transceiver via 
a digital network. 

In the analog channel, continuous time signals broaden and overlap 
through a phenomenon referred to as inter-symbol interference (ISI). To remove 
ISI, conventional modems precode the signals prior to transmission to the analog 

20 channel. After precoding, channel broadening does not produce ISI. Instead, 
channel broadening converts signals that represented signal points of an original 
constellation prior to precoding into signals that represent signal points of an 
extended signal constellation. Conventionally, both original and extended 
constellations are derived from the quantization levels of the PCM vocoder. 

25 Precoding based on such constellations provides good noise performance in the 
absence of channel noise and echo. 

Quantization replaces the continuous values of signals received from the 
analog channel by discrete levels through a process that includes sampling and 
either truncation or rounding of the received signals. Since quantization replaces 

30 continuous values by discrete levels, quantization introduces noise into the 
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transmitted data. The magnitude of this quantization noise depends on the 
distance between the quantization levels of the PCM vocoder. 

The far-end transceiver transmits signal points downstream to the near-end 
central office via the digital network. In the near-end central office, the signal 
5 points are converted into continuous time signals that are transmitted downstream 
to the modem via the same analog channel that carries other data upstream. The 
downstream transmission does not generate quantization noise if the values of 
signal points from the far-end transceiver correspond to quantization levels in the 
near-end central office. Quantization noise does not occur, because the digital 
10 network does not distort signal points. Thus, the near-end central office receives 
from the far-end transceiver signal points that correspond to the quantization 
levels. 

DISCLOSURE OF NVENTION 

Conventional precoders use extended constellations in which the signal 

1 5 points are quantization levels of a PCM vocoder. However, the PCM vocoder 
receives the signal points from an analog channel, and the analog channel 
introduces other noise besides ISI into signals. This other channel noise causes 
the received signal points to take values that differ from those of the extended 
constellation and to differ from the quantization levels. Also, prior to 

20 quantization in the PCM vocoder, echo from downstream transmission is added to 
the received signal points. The echo also causes the signal points to take values 
that differ from the quantization levels. For both reasons assigning the value of a 
quantization level to each signal point of the extended constellation sometimes 
leads to unacceptable levels of quantization noise. 

25 In one aspect, the invention features a process for transmitting digital data 

to an AJD converter via an analog channel. The process includes generating a 
sequence of output signals by precoding a sequence of input signal points to 
precompensate for intersymbol interference (ISI) in the analog channel. In 
response to the precoding matching the ISI, at least one of the output signals 

30 would be distorted by the ISI to a signal representative of a signal point lying 
between quantization levels of the AJD converter. In response to the precoding 
matching the ISI, others of the output signals would be distorted by the ISI to 
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signals representative of signal points that are quantization levels of the A/D 
converter. A majority of the input signal points are quantization levels of the A/D 
converter. 

5 

In another aspect, the invention features a process for communicating data 
over an analog channel in both downstream and upstream directions. The process 
includes monitoring an echo level caused by downstream data transmission and 
resetting a power level for downstream transmissions over the analog channel to a 
10 lower value. The act of resetting is responsive to determining that the monitored 
echo level interferes with upstream data transmissions over the analog channel. 

Other advantages of the invention will be apparent to those of skill in the 
art from the description and drawings herein. 

BRIEF DESCRIPTION OF DRAWINGS 

1 5 Figure 1 shows a communication system for transmitting digital data; 

Figure 2 is a block diagram that shows how data flows upstream in the 
communication system of Figure 1; 

Figure 3 shows the // -law quantization levels used by some PCM 
vocoders; 

20 Figure 4 shows an underlying space of signal points for constructing 

extended constellations with minimum distance 32 for precoders that transmit to 
PCM vocoders; 

Figures 5A-5B show an extended constellation with minimum distance 32 
that is used to precode data for transmission to a PCM vocoder; 
25 Figures 6A-6B show another extended constellation with minimum 

distance 32 that is used to precode data for transmission to a PCM vocoder; 

Figure 1 shows an underlying space of signal points for constructing 
extended constellations with minimum distance 16 for precoders that transmit to 
PCM vocoders; 

30 Figures 8A-8B show an extended constellation with minimum distance 16 

that is used to precode data for transmission to a PCM vocoder; 
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Figures 9A-9B show another extended constellation with minimum 
distance 16 that is used to precode data for transmission to a PCM vocoder; 

Figure 10 is a block diagram that shows how data flows downstream in 
one embodiment of the communication system of Figure 1 ; and 
5 Figure 1 1 is a flow chart for a process that sets downstream power levels 

in the communication system of Figures 1, 2, and 10. 

MODES FOR CARRYING OUT THE INVENTION 

In conventional modems, quantization noise occurs, because transmitted 
signal points are distorted by channel noise before the signal points are quantized 

10 by a PCM vocoder. Similarly, echoes in a full-duplex system distort transmitted 
signal points before those points are quantized by the PCM vocoder. In light of 
such a situation, eliminating quantization noise is not possible. 

The various embodiments reduce occurrences of dangerous quantization 
noise with values that are too large to be corrected by error-correcting coding - 

IS techniques. The reduction in such large quantization noise can thus, improve the 
receiver's capability to recover transmitted data. 

Figure 1 shows a full-duplex communication system 10 for digital data. 
The system 10 includes a user transceiver 12, a near-end central office 14, and a 
far-end transceiver 16. The user transceiver 12 couples to the near-end central 

20 office 14 via an analog channel 20, e.g., a telephone local loop. An exemplary 
user transceiver 12 includes a modem. The far-end transceiver 16 couples to the 
near-end central office 14 via a digital network 22. Exemplary far-end 
transceivers 16 include servers for Internet service providers. 

Herein, upstream and downstream refer to data flows from user 

25 transceiver 12 to far-end transceiver 16 and from the far-end transceiver 16 to the 
user transceiver 12, respectively. The two data flows differ in whether central 
office 14 and PCM vocoder therein process the data after or before transmission 
of the data over analog channel 20. 

Figure 2 illustrates how system 10 of Figure 1 processes upstream flowing 

30 digital data. A transmitter located in near-end transceiver 12 receives a sequence 
of digital data, D n . The transmitter sends the received D„s to trellis encoder 28 
where the D n s are sequentially encoded to produce an output stream of encoded 
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digital signal points, P n . The encoding allows subsequent reduction of 
transmission errors in far-end transceiver 16. Exemplary encoders 28 are the 4D 
16-, 32- or 64-state trellis encoders used in V.34 and V.90 modems. The details 
for such encoders are described in U.S. Patent Nos. 5,418,798 and 4,713,817, 
5 which are incorporated by reference herein in their entirety. 

Trellis encoder 28 sends the P n s to precoder 30 which generates a 
sequence of signal points, S„ that are precompensated for inter-symbol 
interference (ISI) in analog channel 20'. From the precoder 30, continuous time 
signals representative of signal points, S„, go to amplifier 32. The amplifier 32 
10 amplifies the signals by a factor "a* 1 H that is selected to precompensate for 

attenuation in the analog channel 20* and transmits the amplified signals to analog 
channel 20'. 

For analog channel 20', input and output continuous time signals represent 
respective digital signals a" 1 S n and V n , which are sent during signal transmission 

1 5 intervals. Below, we will primarily refer to these equivalent digital signals. 

Analog channel 20' includes analog elements between precoder 30 in the 
user transceiver 12 and PCM vocoder 34 in near-end central office 14. Thus, the 
channel 20' includes analog channel 20, output portions of user transceiver 12, 
and input portions of near-end central office 14, as shown in Figure 1. The analog 

20 channel 20' attenuates transmitted signal points by a factor a and filters the signal 
points with equivalent digital filter responses h§s. The "hi" describes the amount 
of ISI that a signal point of the "i"-th earlier transmission interval produces in a 
signal point of the present transmission interval. The analog channel 20' also adds 
channel noise to an input signal, e.g., Gaussian noise, to produce an output signal 

25 that is representative of a signal point, V n . 

Prior to and/or during data communications, user transceiver 12 and far- 
end central office 16 perform channel testing to estimate the parameters hi and a, 
which characterize analog channel 20'. The channel testing enables the user 
transceiver 12 to set parameters hi', a" 1 ' of the precoder 30 and amplifier 32, 

30 respectively, to precompensate for filtering, hi, and attenuation, a, generated by 
the channel 20*. 
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From analog channel 20', the output signal points, V n , undergo further 
corruption by echoes in near-end central office 14. The echoes result from 
impedance mismatches in a hybrid device 36 located in the near-end central office 
14. The hybrid device 36 causes downstream flowing signal points to be partially 
5 reflected upstream. The echo corrupted signal points, V n ' (V n = V n + echo), are 
received by PCM vocoder 34, which quantizes the signal points, V n \ to produce 
output digital words, R„. Since the signal points, V„', include channel noise and 
echo, the PCM vocoder 34 introduces quantization noise into the digital words, 
R n . 

10 PCM vocoder 34 quantizes the corrupted signal points, V n \ into 8 bit 

words according to the known// -law or the known A-law. Below, the // -law is 
used as an exemplary quantization law for the PCM vocoder 34. The near-end 
central office 14 transmits the sequence of R«s upstream to far-end transceiver 16 
via digital network 22. 

15 In far-end transceiver 16, a receiver receives the "echo" corrupting digital 

words, R„, from digital network 22. In parallel, each R«s is sent to a monitoring 
device and processed to produce a signal point Rn* from which an estimated value 
of echo has been subtracted. The monitoring device derives reliability 
information from each Rn, The Viterbi decoder 38 decodes the sequence of echo 

20 subtracted R«'s to produce a sequence of output data values, D n 's. The D„'s are 
estimations of the input data values, D n , originally transmitted by user transceiver 
12. The encoding previously performed by trellis encoder 28 enables the far-end 
transceiver 16 to use Viterbi decoder 38 to recover the transmitted data from the 
noise-corrupted digital words, R„\ 

25 The Viterbi decoder 38 takes account of the reliability information derived 

from the received digital words, R«, prior to the removal of echo. Digital words, 
R,,, that correspond to large quantization levels of PCM vocoder 34 are less 
reliable, because these R„s may contain large quantization noise. The reliability 
information is also a function of the minimum distance, d, of the constellation. 

30 The reliability information is used to scale the one-dimensional (ID) 

branch metrics that are calculated at the front end of the Viterbi decoder 38. The 
value of scaling factor p(Rn) depends on the relationship between the maximum 



SOOCIO <WO 0178241A2J_> 



WO 01/78241 PCT/US01/11162 

7 

possible quantization noise, q, for a value of Rn, and the minimum distance, d, in 
the ID constellation of signal points, P n . An exemplary P(Rn) has the following 
form: 

p(R„) - 1 for q < d/2; p(R«) = (0.75) 2 for q = d/2; 
5 p(R n ) = (0.375) 2 for q = d; p(R„) - (0.1 875) 2 for q > d. 

The value of p(R n ) is roughly inversely related to the magnitude of the signal 
point represented by R n , because quantization noise grows with the magnitude of 
the signal point. 

The Viterbi decoder 38 calculates a path metric for each encoder state (or 

10 each surviving path). For 4-dimensional (4D) trellis codes, each path metric is an 
accumulation of 4D branch metrics. Each 4D branch metric is associated with a 
4D subset of signal points of a 4D constellation. Since the 4D subsets are 
constructed from concatenations of four ID subsets of a ID extended 
constellation, each 4D branch metric is the sum of four ID branch metrics. 

15 For the 4D trellis codes, scaled ID branch metrics are then calculated as 

follows. Depending on the number of states of the trellis code, the ID extended 
constellation, e.g., a constellation of Fig. 5, 6, 8, or 9, is partitioned into two or 
four ID subsets. In Figs. 5, 6, 8, and 9, each ID subset consists of signal points 
that correspond to bit patterns with the same value for the last bit (for two ID 

20 subsets) or the last two bits (for four ID subsets). For a received signal point Rn 1 , 
a ID metric is calculated for each ID subset The ID metric is the squared 
Euclidean distance between Rq 9 and the closest signal point in the ID subset. 
Then, the 1 D branch metric is scaled before being used to calculate 4D branch 
metrics and path metrics. 

25 Referring again to user transceiver 12, precoder 30 is a Tomlinson type 

device that precompensates the sequence of signal points, P n , for ISI in analog 
channel 20'. The precompensation involves replacing input signal points, P n , of 
an original constellation, which is derived from the quantization levels of the 
PCM vocoder 34, by output signal points, S„. Provided that the precoding is 

30 matched to the channel ISI, subsequent filtering by analog channel 20' converts 
the output signal points, S n , into signal points, V„, which, in the absence of 
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channel noise, belong to an extended constellation over the original constellation. 
The original and extended constellations define the precoder 30. 

The precoder 30 includes a feedback loop 42, an adder 44, and a modulo 
device 46. 

5 The feedback loop 42 includes a finite impulse response (FIR) filter 48, 

which filters signal points, S n , output during earlier signaling intervals. The FIR 
filter 48 has a digital response matched to that of channel 20'. In an exemplary 
precoder 30, the response of filter 48 is matched to that of the channel 20* during 
an initialization process. The filter's response is: 

••I 

where Z~'is a delay of"/" signaling intervals. During each signaling interval, FIR 
filter 48 produces a feed back signal point, F n . 

The amount of feedback by filter 48 is described by a parameter y, defined 

as: 

15 T-£lV|. 

/-I 

Larger feedback, i.e., y, leads to larger average magnitudes for output signal 
points, V n at the near-end central office 14. Since larger V n s lead to larger 
quantization noise, smaller values of y are generally desirable to keep quantization 
noise small. In part, the value of y is set by properties of output portions of user > 
20 transceiver 12. The value of y also determines the size of extended constellations. 

During each signaling interval, the adder 44 subtracts the feedback signal 
F n from the input signal point P n to produce a signal, Q n , that is precompensated 
for ISI in analog channel 20\ The signal, Q„, is given by: 

1-1 

25 The modulo device 46 adds a positive or negative modulo amount, M(P„), 

to the Q n to produce an output signal, S n , that lies in a preselected range, i.e., S n = 
Q n + M(P„). In the absence of channel noise, transmission of S n through the 
analog channel 20' produces: 
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Thus, the V n s belong to an extended constellation constructed over the 
original-constellation of the P n s by adding modulo amounts M(P n ). The extended 
constellation includes the original constellation of the signal points, P„, and signal 
5 points offset from points of the original constellation by the modulo amounts 

M(P„). The signal points related by modulo amounts M(P„) are recognized by the 
far-end transceiver 16 as corresponding to the same original signal point, P„. 

Since the signal points of the extended constellation are non-uniformly 
spaced, the modulo amounts, M(P„), depend on the value of P„. Modulo device 
10 46 includes an input terminal 52 for the value of P„. 

Modulo device 46 adds a positive or negative modulo amount, M(P n ), to a 
signal point, Q n , in response to the value of Q„ being, respectively, less than a 
preselected negative threshold or greater than a preselected positive threshold. 
Some embodiments of modulo device 46 use variable thresholds whose values 
1 5 depend on P„ and are equal to - ! /2M(P„). Other embodiments of modulo device 
46 use fixed thresholds. The negative and positive fixed thresholds are, e.g., T, = 
-V* times the maximum value of all positive modulo amounts M(P n ), and T+ = -!4 
times the minimum value of all negative modulo amounts, M(P„), respectively. 
Here, the maximum or minimum refers to maximum or minimum values of M(P n ) 
20 for signal points in the original constellation. 

The magnitude of quantization noise increases as magnitudes of signal 
points, V n , increase. For signal points with large magnitudes, echo and channel 
noise can induce quantization noise that cannot be corrected by far-end 
transceiver 16. Thus, a precoder 30 that sends, on the average, smaller signal 
25 points, V n , to PCM vocoder 34 will ordinarily produce lower amounts of this 
dangerous type of quantization noise. Since the magnitudes of fixed thresholds 
are larger than the variable thresholds, embodiments of modulo device 46 with 
fixed thresholds will less often add modulo amounts to signal points Q n and thus, 
will less often generate large magnitude signal points, V n , at the PCM vocoder 34. 
30 Thus, a precoder 30 with a fixed threshold often produces lower quantization 

noise than a precoder 30 with variable thresholds. On the other hand, a precoder 
30 with variable thresholds should produce lower average output powers. Thus, a 
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attenuation in analog channel 20'. 

Conventional precoders tried to precompensate for ISI in analog channel 
20' so that in the absence of channel noise and echo, signal points would have 
5 exactly the values of the quantization levels upon arrival at a receiver's PCM 
vocoder, e.g., PCM vocoder 34 of Figure 2. Unfortunately, channel noise and 
echo cannot be predicted, and thus, cannot be precompensated before 
transmission. In the presence of substantial channel noise and echo, conventional 
precoding cannot match signal points to quantization levels at a receiver's PCM 

1 0 vocoder and thus, conventional precoding may produce large quantization noise. 

Precoder 30 has an extended constellation that is, on the average, less 
likely to produce large quantization noise in the presence of echo and channel 
noise. The smaller quantization noise results, because the signal points of the 
extended constellation of precoder 30 have a smaller average magnitude than in a 

1 5 conventional extended constellation with the same number of signal points and 
minimum distance. The smaller quantization noise is more easily corrected by 
subsequent decoding in far-end transceiver 16. 

Figure 3 shows the quantization levels of a PCM vocoder, which 
implements pi -law quantization. The /i -law includes a zero quantization level, 

20 127 positive, levels, and 127 negative levels. The positive and negative 

quantization levels are symmetrically positioned about the zero quantization level 
and lie in segments ±Ai - ±Ag. Within a segment ±A| - ±A$, the quantization 
levels are approximately uniformly spaced Between segments, distances 
between the levels increase with segment index from 1 for segments ±A t to 128 

25 for segments ±A$. 

The distance between adjacent quantization levels determines the 
quantization noise associated with a signal point located near the levels. Thus, 
quantization errors are higher for signal points located in segments ±Ag than for 
signal points located in the other segments ±A|- ±A7. The magnitude of 

30 quantization noise will, on the average, be smaller if the precoder's extended 
constellation has signal points of a smaller average magnitude. 
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Referring again to Figure 2, trellis encoder 28 produces signal points, P n , 
that correspond to quantization levels of PCM vocoder 34. When precoder 30 and 
amplifier 32 are set up to exactly precompensate channel ISI and attenuation, 
which is referred to as matched to the channel ISI, the precoder 30 transforms 
5 signal points, P n , into output signal points, S n . For such a set up, the channel ISI 
would convert output signals representative of the S n s to signals representing 
points of an extended constellation in the absence of channel noise and echo. 
Some of the signal points of the extended constellation associated with the 
precoder 30 are not quantization levels of the PCM vocoder 34. Using signal 
10 points that do not correspond to valid quantization levels enables the precoder 30 
to reduce the average magnitude of the signal points of the extended constellation. 
Reducing the average magnitude of such signal points lowers the average 
magnitude of quantization noise from PCM vocoder 34 in the presence of channel 
noise and echo so that quantization noise can be more easily corrected during 
1 5 decoding in far-end transceiver 1 6. 

Since the new extended constellations have signal points that are not 
quantization levels, these constellations produce some quantization noise even in 
the absence of channel noise and echo. The system 10 trades off this new 
production of quantization noise against a reduction in large quantization noise, 
20 e.g., noise associated with segments ±A« and in some embodiments segments ±A 7 
of PCM vocoder 34, in the presence of channel noise and echo. Exemplary large 
quantization noise has a magnitude that is two or more times the minimum 
distance, d, of the associated constellation. 

The new extended constellations of precoder 30 are constructed from 
25 underlying spaces of signal points. The underlying spaces take account of the 
non-uniformity of the quantization levels of the jx-law. 

Figure 4 shows an underlying space 54 for constructing new extended 
constellations with a minimum distance of 32 between signal points therein. The 
constellations are designed for transmitting signal points to PCM vocoder 34, 
30 which uses |i-law quantization. The space 54 includes low, medium, and high 
magnitude signal points 55 - 57. The low magnitude points 55 are quantization 
levels of the PCM vocoder 34 and have the lowest magnitudes, i.e., up to 991.5. 
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The low magnitude points 55 are uniformly spaced at the minimum distance of 
32. The medium magnitude points 56 have larger magnitudes, i.e., between 
1 ,039.5 and 1 ,999.5, and are also quantization levels of the PCM vocoder 34. The 
medium magnitude points 56 are uniformly spaced at distances of 64. The high 
5 magnitude points 57 have the largest magnitudes, i.e., greater than 2,063.5, and 
include signal points that are quantization levels of the PCM vocoder 34 and 
signal points that are not quantization levels of the PCM vocoder 34. The signal 
points 57 that are not quantization levels of the ji-law are indicated by ,, *s". 

The inclusion of signal points that are not quantization levels of the |a-law 

10 enables reducing distances between high magnitude points 57 from about 128 for 
segments ±Ag of PCM vocoder 34, as shown in Figure 3, to 32 in the underlying 
space 54. The smaller distances between signal points enables a higher density 
packing of signal points in an extended constellation derived from the underlying 
space 54 than in an extended constellation derived solely from the quantization 

1 5 levels of the n-law, as shown in Figure 3. The higher density packing implies that 
echo and channel noise are more likely to shift signal points, V n \ towards smaller 
magnitude regions of the ji-law where subsequent quantization noise will be 
smaller. The smaller quantization noise can be more easily corrected by decoding 
in Viterbi decoder 38 of the far-end transceiver 16. Thus, a precoder 30 based on 

20 an extended constellation derived from the underlying space 54 should generate 
smaller magnitude quantization noise than a conventional precoder that uses an 
extended constellation derived solely from the quantization levels shown in 
Figure 3. 

Figures 5 A-6B and 6A-6B show extended constellations derived from 
25 underlying space 54 of Figure 4. The extended constellations provide minimum 
distances of 32 between signal points of 40-point and 48-point original 
constellations 62, 72, respectively. The signal points 62, 72 are representative of 
bit patterns 63, 73. The extended constellations also have upper portions 64, 74 
and lower portions 65, 75 in which signal points are related to signal points of the 
30 original constellations 62, 72 by addition of positive modular amounts 67, 77 and 
negative modular amounts 68, 78, respectively. The signal points that are related 
by additions of modulo amounts are representative of the same bit patterns 63, 73. 
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Exemplary fixed thresholds for adding positive/negative modular amounts 
to signal point, Q n , in precoder 30 can be set at, for example, -908/+908 and - 
1,040/+J,040 in the extended constellations of Figures 5A-5B and 6A-6B, 
respectively. The variable thresholds for adding modulo amounts are minus one 
5 half times the values of the modulo amounts themselves. 

To derive extended constellations of Figures 5A-5B or 6A-6B from 
underlying space 54 of Figure 4, one counts the needed number of signal points in 
the desired extended constellation. The needed number of signal points is 
determined by the number of upper portions 64, 74 and lower portions 65, 75 
1 0 desired. Then, one identifies the needed number of signal points of lowest 
magnitude from the underlying space 54 as the signal points of the extended 
constellation. 

Figure 7 shows an underlying space 80 useful for constructing extended 
constellations with minimum distance of 16 between signal points therein. The 

15 constellations are designed for a precoder 30 that transmits to a PCM vocoder 34, 
as shown in Figure 2. The underlying space 80 includes low, medium, and high 
magnitude signal points 82, 84, 86. The low and medium magnitude points 82, 84 
are ja-law quantization levels of the PCM vocoder 34 and have magnitudes up to 
991.5. The low and medium magnitude points 82, 84 are spaced at distances of 

20 up to 32. The high magnitude points 86 have larger magnitudes, i.e., between 
1,023.5 and 1,807.5, and include signal points that are quantization levels of the 
PCM vocoder 34 and signal points that are not quantization levels of the PCM 
vocoder 34. The signal points that are not quantization levels of the PCM 
vocoder 34 are indicated by tt *s". 

25 The inclusion of signal points in space 80 that are not quantization levels 

of the n-law again reduces distances between high magnitude points 86. The 
magnitude of the quantization noise that can be handled by decoder 38 of Figure 2 
is a function of the minimum distance, d, of the constellation and a function of the 
coding performed by trellis encoder 28. Where the magnitude of the quantization 

30 noise is smaller, the noise can he more easily corrected during decoding. For the 
4D 64-state trellis code, the Viterbi decoder 38 can handle quantization noise of 
magnitude d, but not quantization noise of magnitude 2d. If signal points with 
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potential quantization noise of magnitude 2d have to be used in the extended 
constellation, it is not very relevant whether the points correspond to valid 
quantization levels. In fact, a higher density packing of signal points, which is 
achieved by assigning some of the points to invalid quantization levels, increases 
5 the probability that echo or channel noise will lower the magnitudes of signal 
points V n ' to values for which the associated quantization noise can be corrected 
by the decoder 38. 

Figures 8A-8B and 9A-9B show extended constellations derived from 
underlying space 80 of Figure 7. The extended constellations provide 40-point 

10 and 48-point original constellations 92, 102, respectively. In the extended 
constellations, minimum distances between signal points are 16. The signal 
points 92, 102 are representative of bit patterns 93, 103. The extended 
constellations have upper portions 94, 104 and lower portions 95, 105 with signal 
points related to those of the original constellations 92, 102 by addition of positive 

15 modular amounts 97, 107 and negative modular amounts 98, 108, respectively. 
The related signal points correspond to the same bit patterns 93, 103. 
^ Exemplary fixed thresholds for adding positive/negative modular amounts 

to signal point, Q n , in precoder 30 can be set at, for example, -459/+459 and - 
524/+S24 in the extended constellations of Figures 8A-8B and 9A-9B, 

20 respectively. 

To derive the extended constellations of Figures 8A-8B or 9A-9B, one 
counts the number of signal points in the extended constellation and uses the 
signal points of lowest magnitude from the underlying space 80 of Figure 7 as the 
signal points of the extended constellation. This construction enables noise and 

25 echo to shift the signal points, V n ', to smaller values where quantization noise is 
smaller and easier to correct during subsequent decoding. 

Referring to Figures 1 and 2, an embodiment of communication system 10 
in which near-end central office 14 has an A/D converter that operates according 
to another quantization law also has an underlying space that is useful in 

30 designing the extended constellation of precoder 30. To construct the underlying 
space with a preselected minimum distance between its signal points, the 
quantization levels of the quantization law are labeled as high or low magnitude 
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levels. At high magnitude levels, quantization noise is too large to be corrected 
by a preselected channel-coding scheme with the constellation derived from the 
underlying space. For high magnitude levels, a signal point corresponding to each 
quantization level is added to the underlying space. Between the high magnitude 
5 levels, additional signal points are added to the underlying space to ensure that 
distances between adjacent signal points are equal to the preselected minimum 
distance. Finally, the underlying space is completed by adding signal points 
corresponding to the low magnitude quantization levels so that the minimum 
distance between these points is the same as the preselected minimum distance. 

10 An extended constellation is formed by selecting from the underlying 

space the needed number of signal points of lowest magnitude. 

Since echoes from downstream transmission increase quantization noise 
associated with upstream transmission. Some embodiments of communication 
system 10, as shown in Figure I, reduce echo levels from downstream 

IS transmission in order to lower quantization noise associated with upstream 

transmission. Figure 10 illustrates one such embodiment of the communication 
system 10. 

Figure 10 is a block diagram showing downstream transmission in one 
embodiment of communication system 10 of Figure 1. In a downstream 

20 transmission, far-end transceiver 16 sends input digital data, D n , to a channel 
encoder 1 10. The encoder 1 10 produces encoded signal points, P n , by a coding 
scheme that can reduce the signal power transmitted to analog channel 20 f without 
sacrificing the data rate or degrading the error rate performance in the 
downstream transmission. Exemplary encoders 1 10 include trellis encoders 

25 compatible with the V.34 and V.90 standards and probabilistic trellis encoders as 
described in U.S. patent No. 6,1 57,678, which is incorporated herein by reference 
in its entirety. The encoder 1 10 transmits a sequence of the signal points P„ to 
near-end central office 14 via digital network 22. 

The lowered downstream power reduces echo to upstream transmissions 

30 in near-end central office 14. The lowered echo reduces quantization noise in the 
upstream transmissions. In some embodiments, downstream average power 
levels are reduced by about 3-6 decibels with respect to optimal power or 
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regulatory allowed power levels for such transmissions in order to increase the 
data rate for upstream transmissions. In exemplary embodiments, the downstream 
power is reduced by using a constellation with a reduced minimum distance. 
In the near-end central office 14, PCM vocoder 34' converts the digital 
5 signal points, P n > from far-end transceiver 16 into analog signals. The output 
analog signals are continuous in time, but represent digital signal points, X n . The 
conversion does not produce quantization noise, because the constellation of the 
P n s only includes quantization levels of the PCM vocoder 34*. Furthermore, 
unlike an analog channel, a digital network 22 does not distort the signal points, 

1 0 P n , transmitted therethrough. After conversion, the signals representing the X„s 
are sent to hybrid device 36. From the signal representing X„, the hybrid device 
36 produces an output signal representing signal point Xn' in the downstream and 
an echo in the upstream. 

The analog channel 20' distorts the signals representing signal points, X„\ 

15 which were received from hybrid device 36, with channel noise, ISI, and 

attenuation prior to delivering distorted signals representing signal points, T n , to 
user transceiver 12. 

The user transceiver 12 includes a decoder 1 14 that corrects transmission 
noise and recovers a sequence of estimated data values, D n *. The decoder 1 14 

20 uses a decoding algorithm adapted to the type of encoding performed in far-end 
transceiver 16. For example, if the far-end transceiver 16 performed trellis 
encoding, the decoder 1 14 performs a Viterbi decoding algorithm. 

Figure 1 1 shows a process 120 used by far-end transceiver 16 of Figures 1, 
2, and 10 to set transmission powers. The far-end transceiver 16 monitors echo 

25 levels produced by downstream transmission (step 1 22). The echo is produced by 
hybrid device 36 in near-end central office 14. If the echo level is large enough to 
interfere with upstream data transmission, e.g., by generation of quantization 
noise, the far-end transceiver 16 reduces the average downstream power to lower 
the echo level (124). Reducing the downstream power my include using a 

30 constellation that has a smaller size or a smaller minimum distance for 

downstream transmissions. The far-end transceiver 16 may also apply a coding 
scheme to data prior to downstream transmission so that the downstream power 
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can be reduced without lowering the downstream data rate or degrading the 
downstream error performance. 

Referring again to Figure 2, other embodiments of precoder 30 use an 
extended constellation with a size that is more than 3 times that of the original 
5 constellation. For example, the extended constellation may have more than one 
upper portion and/or more than one lower portion. Such larger constellations may 
be desirable for larger values of feedback parameter y. For such values, the 
feedback loop 42 generates signals F„ of larger magnitude and adder 44 is more 
likely to produce signals Q n of larger magnitude. 

10 In some embodiments, the extended constellation is a non- integral number 

of times as large as the original constellation. 

In other embodiments, PCM vocoder 34 of near-end central office 14 is 
replaced by a new analog-to-digital (A/D) converter The new A/D converter 
quantizes received signal points according to a new quantization law and not the 

1 5 |i-law. For such embodiments, precoder 30 has an original constellation that 
includes signal points that correspond to the quantization levels of the new law 
and an extended constellation that includes some signal points that are 
quantization levels and other signal points that are not quantization levels of the 
new law. 

20 In some embodiments, trellis encoder 28 and precoder 30 are combined 

into a single encoder/precoder. The combined encoder/precoder is still 
characterized by original and extended constellations. The combined 
encoder/precoder produces signal points, S n , of the original constellation when 
configured to precompensate for an analog channel 20' with no ISI, i.e., when the 

25 feedback coefficients are set to zero. The constellations have signal points 
whose values are related to the quantization levels of the near-end central office 
14 as previously described. 

In some embodiments a portion of the signal points of the original 
constellation do not correspond to quantization levels of the PCM vocoder 34. 

30 The majority of the points in the original constellation correspond, however to 
quantization levels. 
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Other embodiments will be apparent to those of skill in the art in light of 
the above description, figures, and claims. 
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CLAIMS 

1 . A process for transmitting digital data to an A/D converter via an analog 
channel, comprising: 

generating a sequence of output signals by precoding a sequence of input signal 
points to precompensate for ISI in the analog channel, at least one of the output signals 
5 would be distorted by the ISI to a signal representative of a signal point lying between 
quantization levels of the A/D converter if the precoding matches the ISI, others of the 
output signals would be distorted by the ISI to signals representative of signal points that 
are quantization levels of the A/D converter if the precoding matches the ISI, a majority 
of the input signal points are quantization levels of the A/D converter. 

10 2. The process of claim 1 , wherein the quantization levels are the 

quantization levels of a PCM vocoder. 

3. The process of claim 2, wherein the precoding further comprises: 
precompensating an input signal point for the ISI; and 

adding a modulo amount to the precompensated signal point in response to 
15 precompensated signal point having a value outside of a threshold range. 

4. The process of claim 3, wherein the adding includes determining the value 
of the modulo amount in a manner responsive to the value of the input signal point that 
was precompensated. 

5. The process of claim 4, wherein the threshold range is dependent on the 
20 value of the input signal point that was precompensated. 

6. The process of claim 4, wherein the threshold range is independent of the 
value of the input signal point that was precompensated. 

7. The process of claim 1, wherein another of the output signals would be 
distorted by the ISI to a signal representative of a signal point lying between quantization 
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levels of the A/D converter, first and second ones of the output signals lying between 
different pairs of quantization levels. 

8. The process of claim 1 , wherein each of the input signal points is 
representative of a value of a quantization level of the D/C converter. 

5 9. A transmitter for transmitting digital data to an A/D converter via an 

analog channel, the transmitter comprising: 

a precoder being configured to precompensate a sequence of input signal points 
for ISI in the analog channel and being characterized by an original constellation and an 
extended constellation, a majority of the signal points of the original constellation being 
10 quantization levels of the A/D converter, and the extended constellation including at least 
one signal point that is not a quantization level of the A/D converter. 

1 0, The transmitter of claim 9, wherein the quantization levels characterizing 
a portion of the points in the constellations are quantization levels of a PCM vocoder. 

1 1 • The transmitter of claim 10, further comprising: 
1 5 a trellis encoder to produce the input signal points by encoding digital data, the 

trellis encoder is coupled to transmit the input signal points to the precoder. 

1 2. The transmitter of claim 1 1 , wherein the trellis encoder is configured to 
produce signal points representative of the quantization levels of the PCM vocoder. 

13. The transmitter of claim 10, wherein the precoder trellis encodes the input 
20 signal points and further produces signals representative of signal points of the original 

constellation in response to being configured to precompensate for zero ISI in the analog 
channel. 



14. The transmitter of claim 10, wherein the precoder comprises: 
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a digital filter to generate feedback signal points from precompensated signal 
points produced from the input signal points by the precoder; 

an adder to combine the feedback and associated input signal points; and 
a modulo device to produce a signal point within a threshold range from a signal 
5 point received from the adder. 

1 5. The transmitter of claim 14, wherein the modulo device is configured to 
add a modulo amount to a signal point received from the adder in response to the 
received signal point riot having a value in the threshold range. 

16. The transmitter of claim 14, wherein the threshold range is dependent on 
10 the value of the input signal point that was precompensated. 

1 7. The transmitter of claim 1 4, wherein the threshold range is independent of 
the value of the input signal point that was precompensated. 

18. The transmitter of claim 1 5, wherein the modulo device is configured to 
determine the threshold range from the value of the associated input signal point. 

15 19. The transmitter of claim 9, wherein the extended constellation includes a 

plurality of signal point values that are not equal to quantization levels of the A/D 
converter. 

20. A process for communicating data over an analog channel in both 
downstream and upstream directions, comprising: 
20 monitoring a quantity representative of an echo level caused by downstream data 

transmission; 

resetting a power level for downstream transmissions over the analog channel to a 
lower value in response to determining that the echo level interferes with upstream data 
transmissions over the analog channel. 
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2 1 . The process of claim 20, further comprising: 
channel encoding data prior to transmitting the data downstream; and 

decoding upstream transmitted data to recover the data. 

22. The process of claim 20, further comprising: 

5 resetting includes selecting a constellation for the downstream data transmission 

that produces a lower average power level on the analog channel. 

23. The process of claim 20, wherein the echo level changes the amount of 
quantization noise in upstream transmitted data. 

24. A transceiver for transmitting and receiving digital data via a mixed 

10 channel that includes a digital network and an analog channel serially connected to the 
digital network, comprising: 

a transmitter capable of error-encoding digital data and of transmitting encoded 
data downstream to a target transceiver via the mixed channel; and 

a receiver capable of error-decoding received digital data transmitted upstream 
1 S from the target transceiver via the mixed channel, the transmitter configured to reduce 
downstream transmission power in response to determining that echo from downstream 
transmissions interferes with upstream transmissions from the target transceiver. 

25. The transceiver of claim 24, wherein the transmitter is configured to lower 
the downstream transmission power in response to determining that the power level 

20 causes an above-threshold noise level in upstream transmissions from the target receiver. 

26. The transceiver of claim 24, wherein the transmitter is configured to set 
the power level in part by selecting a signal constellation for transmitting data 
downstream. 

27. The transceiver of claim 24, wherein the transmitter includes a 
25 probabilistic trellis encoder to perform the encoding. 
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28. The transceiver of claim 24, wherein the receiver includes a Viterbi 
decoder and is configured to scale 1 D branch metrics used in the decoder in a manner 
responsive to reliability information derived from the received digital data. 

29. A receiver capable of receiving signals from a mixed channel that includes 
5 a digital network and an analog channel serially connected to the digital network, the 

receiver comprising: 

a Viterbi decoder configured to process the received signals in a manner 
responsive to reliability information derived from the signals, the reliability information 
being indicative of potential magnitudes of quantization noise in the received signals. 

30. The receiver of claim 29, further comprising: 

an adder configured to subtract an estimate of an echo level from each received 
signal and to transmit the echo-subtracted signal to the Viterbi decoder; and 

a device configured to derive the reliability information from the received signals; 

and 

wherein the adder and device are coupled to obtain the received signals in 
parallel. 

3 1 . The receiver of claim 29, wherein the received signals are representative 
of signal points belonging to constellations, and the reliability information corresponding 
to ones of the received signals is a function of minimum distances of the constellations 

20 associated with the ones of the received signals. 

32. The receiver of claim 29, wherein the Viterbi decoder is configured to 
scale 1 D branch metrics that are used in decoding in a manner that is responsive to the 
reliability information. 
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FIG. 3 
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FIG. 6 k 
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FIG. 6B 
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FIG. 8k 



BIT 


SIGNAL 


PATTERN 


POINT 


100100 


327.5 


100101 


311.5 


100110 


295.5 


100111 


279.5 


000000 


263.5 


000001 


235.5 


000010 


219.5 


000011 


203.5 


000100 


187.5 


000101 


171.5 


000110 


155.5 


000111 


139.5 


001000 


123.5 


001001 


105.5 


001010 


89.5 


001011 


73.5 


001100 


57.5 


001101 


40.5 


001110 


24.5 


001111 


8.0 


010000 


-8.0 


010001 


-24.5 


010010 


-40.5 


010011 


-57.5 


010100 


-73.5 


010101 


-89.5 


010110 


-105.5 


010111 


-123.5 


011000 


-139.5 


Ul IUU1 


ice e 
-155.5 


011010 


-171.5 


011011 


-187.5 


011100 


-203.5 


011101 


-219.5 


011110 


-235.5 


011111 


-263.5 


100000 


-279.5 


100001 


-295.5 


100010 


-311.5 


100011 


-327.5 




92^ 



POSITIVE 


NEGATIVE 


MODULE 


MODULE 


AMOUNT 


AMOUNT 


+ 904 


-671 


+ 904 


-671 


+ 904 


-671 


+ 904 


-671 


+ 904 


- 671 

W9 1 


+ 916 


-659 


+ 916 


-659 


+ 916 


-659 


+ 916 


-659 


+ 916 


-659 


+ 916 


-667 

WW/ 


+ 916 


- 683 


+ 916 


- 699 

WJ* 


+ 918 


-713 


+ 902 


-729 


+ 886 


-7415 

9 


+ 870 


-761 

9 Wl 


+ 855 


-776 

9 9 V 


+ 839 


-792 


+ 823.5 


-807 5 

WVf 


+ 807.5 


-823 5 


+ 792 


-839 


+ 776 


-855 


+ 761 


-870 


+ 745 


-886 


+ 729 


-902 


+ 713 


-918 


+ 699 


-916 


+ 683 


-916 


+ 667 


-916 


+ 659 


-916 


+ 659 


-916 


+ 659 


-916 


+ 659 


-916 


+ 659 


-916 


+ 671 


-904 


+ 671 


-904 


+ 671 


-904 


+ 671 


-904 


+ 671 


-904 


97^ 


98^ 



(NSDOCID: <WO 0178241 A2_l_> 



WO 01/78241 



PCT/USOl/11162 



11/15 

FIG. 8d 
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FIG. 9k 
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FIG, 9 B 
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